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Fig. 1 




Fig. 3 



400 



Receive signal requesting generation of a printable 
representation for a multimedia document {or 
receive request requesting generation of a 
multimedia paper document for a multimedia 
document) 



402 



Access the multimedia document identified in step 
402 



404 



Detenmine layout and forniat information to be 
used for generating the printable representation 



406 



Generate a printable representation of the 
multimedia information contained in the multimedia 
document accessed in step 404 based upon the 
layout and format information determined in step 
406 



Print a multimedia paper 
document based upon 

the printable 
representation generated 
in step 408 



410 



Communicate the 
printable representation 
generated in step 408 to 

an output device 



T 



412 
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408 



1 



Perform other operations 

on the printable 
representation generated 
in step 408 



414 



Fig. 4 



<TEMPLATE> 
<ID> 3267 </ID> 

<PAPER_SIZE> letter </PAPER_SIZE> 
<PAPER_COLOR> white </PAPER_COLOR> 
<PAPER_WEIGHT>24lb </PAPER_WElGHT> 

<TITLE_ZONES> 1 <n-|TLE_ZONES> 
<TEXT_ZONES> 2 <n-E>a_ZONES> 
<V1DE0_Z0NES> 1 </VIDEO_Z0NES> 

<TITLE_ZONE> 

<ZONEJD> 0 </ZONEJD> 

<LER_MARG1N> 3.0 </LEFT_MARGIN> 
<R1GHT_MARG1N> 3.0 </RIGHT_MARGlN> 
<TOP_MARGIN> 0.75 </RIGHT_MARGIN> 
<BOTTOM_MARGIN>9.6 </BOTTOM_MARGIN> 
<LANGUAGE> English </U\NGU6E> 
<SOURCE> header </SOURCE> 
<FONT> 

<NAME> Times 

</NAME> 

<POINT_SIZE> 14 <ff'OINT_SIZE> 
<COLOR> black </COLOR> 
<LINE_SPACE> 1 </LINE_SPACE> 
<LINE_LAYOUT> center </LINE_LAYOUT> 

</FONT> 

</riTLE_ZONE> 

<TEXT_ZONE> 

<ZONE_ID> 1 </ZONEJD> 
<LEFT_MARGIN> 1.1 </LEFT_MARGIN> 
<RIGHT_MARGIN> 5.4 </RIGHT_IVlARGlN> 
<TOP_MARGIN> 1.5 </RlGHT_MARGIN> 
<BOTTOM_MARGIN>1.0 </BOTTOM_IVlARGIN> 
<LANGUAGE> English </LANGU6E> 
<SOURCE> Ccaption <SOURCE> 
<FONT> 

<NAME> Garamond 

</NAME> 

<POINT_SIZE> 10 <rt'01NT_SIZE> 
<COLOR> black </COLOR> 
<LINE SPACE> 1 </LINE_SPACE> 
<yFONT> 



<SUBJECT_CHANGE> 

<LINE_SK1P> 1.5 </LINE_SKIP> 

<EMPHASIS> bold 3 </EMPHASIS> 
</SUBJECT_CHANGE> 

<SPEAKER_CHANGE> _ 
<LINE_SKIP> 1.0 </LINE_SKIP> FlQ, OA 

<EMPHASIS> none </EMPHASIS> ^ 

<raPEAKER_CHANGE> 

<ANNOTATIONS> 

<S-rYLE> italic </STYLE> 
<METHOD> underline </METHOD> 
<COLOR> blue </COLOR> 
<WEIGHT> 3 </WEIGHT> 

</ANNOTATIONS> 

</rEXT_ZONE> 



<TEXT_ZONE> 

<ZONE_IO> 2 </ZONEJD> 
<LEFT_MARGIN> 4.6 <LEFT_MARG1N> 
<RIGHT MARGIN> 1.9 </RIGHTJWARGIN> 
<TOP_MARGIN> 1.5 <RIGHT_MARGIN> 
<BOTrOM_MARGlN>1.0 </BOTTOM_MARGiN> 
<LANGUA6E> Japanese <yLANGUGE> 
<SOURCE> 

<NAME> translation 

</NAME> 
</SOURCE> 



<CORRESPONDING_ZONE> 1 
</CORRESPONDING_ZONE> 
<FONT> 

<NAME> AsianGafamond 

<NAME> 

<POINT_SIZE> 10 </POINT_SIZE> 
<COLOR> black </COLOR> 
<LINE_SPACE> 1 </LINE_SPACE> 
</FONT> 



<SUBJECT CHANGE> 

<LINE_SKIP> 1.5 </LINE_SKIP> 
<EMPHASIS> bold 3 </EMPHASIS> 

</SUBJECT_CHANGE> 

<SPEAKER_CHANGE> 

<LINE_SKIP> 1.0 </UNE_SKIP> 
<EMPHASIS> none </EMPHASIS> 

</SPEAKER_CHANGE> 

<ANNOTATIONS> 

<STYLE> italic </STYLE> 
<METHOD> underline <fliflETHOD> 
<COLOR> blue </COLOR> 
<WE!GHT> 3 </WEIGHT> 

</ANNOTAT10NS> 

<n-EXT_ZONE> 

<VIDEO_ZONE> 

<ZONEJD> 3 </ZONEJD> 
<LEFr_MARGIN> 3.2 </LEFT_MARGIN> 
<RIGHT_MARGIN> 4.5 </RIGHT_MARGIN> 
<TOP_MARGIN> 1.5 </RIGHT_MARGIN> 
<BOTTOM_MARGIN> 1.0 </BOTTOM_MARGIN> 
<LANGUAGE> English </LANGU6E> 

<SOURCE> 

<NAME> keyframes 
</NAME> 

<METHOD> time </METHOD> 
<SAMPLING_RATE> 1 </SAMPLING_RATE> 
<ANNOTATION> 

<TYPE> text 

</rYPE> 

<METHOD> box <flWETHCO> 
<CaOR> red </COLOR> 
<WEIGHT> 3 </WEIGHT> 
</ANNOTATION> 
</SOURCE> 



<FRAME_SET> 

<WIDTH> 0.4 </WIDTH> 

<HEIGHT> 0.3 </HEIGHT> FlCI 
<LAYOUT> pa(*ed <1AY0UT> ' 'iJ' 

<GROUPING> 

<SIZE> 4 </SIZE> 
<ANNOTAT!ON> 
<irYPE> barcode 
</TYPE> 

<PLACEMENT> under </PLACEMENT> 

<STYLE> interieaved 2 of 5 </STYLE> 

<WIDTH> 0.8 </WIDTH> 

<HEIGHT> 0.15 </HEIGHT> 
</ANNOTATION> 
</GROUPING> 
</FRAME_SET> 



<A/IDEO_ZONE> 



<n'EMPLATE> 
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From step 406 in Fig. 4 



Divide the multimedia infomiation contained in the multimedia 
document into segments of a particular time length 



From the segments generated in step 602, select segments whose 
multimedia information is to be included in the printable representation 
of the multimedia information 



Detennine pa 


3es on which the segn 


nents selected in st 


3p 604 are to be 






printed 







Generate a printable representation for each page detemiined in step 
606 based upon the layout and fomnat information 




To steps 410, 412, or 414 in Fig. 4 
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Fig. 8C 
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1100 



Topic Of 
Interest 


Keywords & 
Phrases 


Video Features 


Weight 


Terrorism 


Osama 


Face recoKnition: Osama Bin Laden 


0.7 


Afghanistan 


Text recognition: Afghanistan 


0,6 




Building recognition: * OR 
Crowd recognition: * 


0.1 


Company XYZ 


Suzuki 


Face recognition: John Suzuki 


0.8 




Building recognition: * AND 
(Logo recognition: XYZ OR 
Text recognition: XYZ) 


0.75 


Football 


Buffalo Bills 


Face recognition: Jim Kelly OR 
Face recognition: Marv Levy 


0.9 



Fig. 11 



Video frames 



Text info 
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User 
" profile 
info 
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Layout and 

format info 

Other 

multimedia info 



Fig. 12 



1300 



User selects one or more segments from the 
multimedia paper document corresponding to 
multimedia Information that the user wishes to 



User selects preferences and one or more output 
devices for playing back the multimedia 
information corresponding to the segments 

selected in step 1 302 



User requests playback of the multimedia 
information corresponding to the segments 
selected in step 1302 {signal sent to a server) 



1304 



1306 



The server that receives the signal in step 1306 
retrieves multimedia information con-esponding to 
the user-selected segments 



1308 



Multimedia infomiation retrieved by the server Is 
communicated to the one or more output devices 
selected for playback 



h 

1310 



Multimedia information Is played back on the one 
or more output devices selected for playback 
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Fig. 13A 



1350 



User selects a user-selectable identifier 
corresponding to a time point in the multimedia 
recording from where the user wishes to access "^ 
multimedia infomnation 1352 



User selects preferences and one or more output 
devices for playing back the multimedia 
information selected in step 1352 



1354 



User requests playback of the multimedia 
information (signal sent to a server) 



1356 



A server that receives the signal in step 1356 
retrieves multimedia information from the time 
point corresponding to the user-selectable 
identifier selected in step 1 352 



1358 



Multimedia information retrieved by the server in 
step 1358 is communicated to the one or more 
output devices selected for playback 
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1360 



Multimedia information is played back on the one 
or more output devices selected for playback 
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F/g. 13B 



1400 



Determine selection criteria to be used for 

selecting the multimedia information to be included 
in the single printable representation. Determine 
the plurality of multimedia documents from which 
the multimedia information is to be selected 



h 

1402 



Generate a printable representation for each 
multimedia document detemiined in step 1402 if a 
printable representation does not already exist for 
the multimedia document 



1404 



For each multimedia document identified in step 

1402, search pages from the printable 
representation of the multimedia document to 
identify a set of pages that comprise information 
that satisfies the selection criteria determined in 
step 1402 



h 

1406 



Generate a single consolidated printable 
representation that includes the pages determined 
in step 1406 



Generate a single consolidated multimedia paper 
document based upon the printable representation 
generated in step 1408 



1408 



1410 



Fig, 14 



Determine selection criteria to be used for 
selecting the multimedia information to be included 
in the single printable representation. Determine 
the plurality of multimedia documents from which 
the multimedia infomiation is to be selected 



h 

1502 



Q 



For each multimedia document determined in step 
1502, divide the multimedia Information contained 
by the multimedia document into segments of a 
particular time lengtii 



1504 



For each multimedia document identified in step 
1 502, determine those segments of the multimedia 
document that comprise information that satisfies ^ 
the selection criteria identified in step 1 502 1 506 



Generate a single consolidated printable 
representation based upon the segments 
determined in step 1506 



h 

1508 



Generate a single consolidated multimedia paper 
document based upon the printable representation 

generated in step 1508 



h 

1510 



Fig. 15 




Fig. 16A 




Fig. 16B 



The Newshour, (PBS, Channel 233) 

Start Time: 6:01pm - Record Time: 00:54:49mln 
June 5, 2001 
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Fig. 16C 
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CNN News Site (Channel 203) 

Recording Time: I2:59pni -Total Time: 00:56:40 min 
May 30, 2001 
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CNN News Site (Channel 203) 
Recording Time: 12:59pm -Total Time: 00:56:40 min 
May 30, 2001 
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CNN News Site (Channel 203) 

Recording Time: 12:59pni -Total Time: 00:56:40 min 
May 30, 2001 
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Fig. 19 
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Recording Time: 6:0lpm -Total Time: 0«:S4:49min: 



HardbaU (CNBC, Channd 356) 
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Fig. 20 
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Newshour (PBS, Channel 233) 

Recording Timi;: 6:0 J pm -Total Time: 00:54 :49iiiia; June 5, 2001 




HardbaU (CNBC, Channel 356) 

Recording rime: 5:00pm -Total Time: 00:59:59 roin; September 14, 2001 
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MDA Meeting 
Recording Time: 10:03am -Total Time: 00:29:21 min 
April 13, 2001 
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Fig. 22 



